WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 6 ; 
H04N 7/00, H04L 12/00 



Al 



(11) International Publication Number: WO 97/33434 

(43) International Publication Date: 12 September 1997 (12.09.97) 



(21) International Application Number: PCT/US97/03525 

(22) International Filing Date: 7 March 1997 (07.03.97) 



(30) Priority Data: 
08/613,144 
08/615,143 
08/622,474 



8 March 1996 (08.03.96) US 
14 March 1996 (14.03.96) US 
25 March 1996 (25.03.96) US 



(71) Applicants (for all designated States except US): ACTV, INC. 

[US/US]; Rockefeller Center, Suite 2401, 1270 Avenue of 
the Americas, New York, NY 10020 (US). EARTH WEB, 
INC. [US/US]; 38th floor, 3 Park Avenue, New York, NY 
10016 (US). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): HIDARY, Jack, D. 
[US/US]; 38th floor, 3 Park Avenue, New York, NY 10016 
(US). ULLMAN, Craig [US/US]; 112 Willow Street #4A, 
Brooklyn, NY 11203 (US). SPIVACK, Nova, T. [US/US]; 
38th floor, 3 Park Avenue, New York, NY 10016 (US). 

(74) Agents: WEILACHER, Robert, G. et al.; Beveridge, DeGrandi, 
Weilacher & Young, LXJ>., Suite 800, 1850 M Street, 
N.W., Washington, DC 20036 (US). 



(81) Designated States: AL, AM, AT. AU, AZ, BA, BB, BG, BR, 
BY, CA, CH, CN, CU, CZ, DE, DK, EE, ES, FI, GB, GE, 
GH, HU, IL, IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, 
LS. LT, LU f LV, MD, MG, MK, MN. MW, MX, NO, NZ, 
PL, PT, RO, RU, SD, SE, SG, SI, SK. XT, TM, TO, TT. 
UA, UG, US, UZ, VN, YU, ARIPO patent (GH, KE. LS, 
MW, SD, SZ, UG), Eurasian patent (AM, AZ, BY, KG, KZ, 
MD, RU, TJ, TM), European patent (AT, BE, CH, DE, DK, 
ES, Fl FR, GB, GR, IE, IT, LU, MC, NL, PT, SE), OAPI 
patent (BF, BJ, CF, CG, CI, CM, GA. GN, ML, MR, NE, 
SN, TD, TG). 



Published 

With international search report. 



(54) Title: AN INTEGRATED INTERACTIVE VIDEO AND INTERNET SYSTEM 
(57) Abstract 



A system for integrating video program- 
ming with the vast information resources of the 
Internet (20). A computer-based system (16, 
1 14) receives a video program and uniform re- 
source locators (URLs). The URLs are inter- 
preted by the system (12) to direct the system 
to the Web site locations to retrieve related Web 
pages (98). The video program signal can be 
displayed on a video window on a conventional 
personal computer screen (18). The actual re- 
trieved Web pages can be time stamped and dis- 
played, on another portion of the display screen 
(18), when predetermined related video content 
is displayed in the video window. The computer- 
based system can receive the URLs embedded in 
the video program (86) or directly through an In- 
ternet connection (94), at times specified by TV 
broadcasters in advance. 
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This application is a continuation-in-part of U.S. Application Serial 

No. , filed March 14, 1996, entitled "AN INTEGRATED 

INTERACTIVE VIDEO AND INTERNET SYSTEM" (Attorney Docket No. 4247), 

which is a continuation-in-part of U.S. Application Serial No. _^ 

filed March 8, 1996, entitled "AN INTEGRATED INTERACTIVE VIDEO AND 
INTERNET SYSTEM" (Attorney Docket No. 4246). 

BACKGROUND OF THE INVENTION! 

Today, the capabilities of computers to provide massive amounts of 
educational and entertainment information has exploded with the Internet. The 
Internet has the power to transform society through unprecedented levels of 
information flow between members. Currently, on-line systems offer a variety of 
different services to users, including news feeds, electronic databases (either 
searchable by the user directly on the on-line system, or downloadable to the 
user's own computer), private message services, electronic newsletters, real time 
games for play by several users at the same time, and job placement services, to 
name a few. However, today, most on-line communications occur merely 
through text. This currently stands in great contrast to the audio/visual 
presentation of the alternative electronic medium, television. However, it is 
expected that as multi-media's incessant growth continues, audio/visual . 
programs will proliferate and text will become less and less dominant in the on- 
line environment. Even though these programs will be introduced, the Internet, 
will remain essentially user unfriendly due to its very massiveness, organization, 



WO 97/33434 



PCT/US97/03525 



3 

and randomness. Simply stated, there is no order or direction in the Internet. 
Specific pieces of information are many times hard to find, and harder yet, is the 
ability to put that piece of information into a meaningful context. 

Television, on the other hand, has been criticized for being a passive 
5 medium - "chewing gum for the eyes," as Fred Allen once observed. Television 
has always been something you watched, not something you do. Many social 
critics believe that the passivity television depends on has seeped into our entire 
culture, turning a nation of citizens into a nation of viewers. While interactive 
television systems have increased the level of user interaction, and thus, 

10 provided greater learning and entertainment opportunities, vast information 
resources such as databases are inaccessible from such a medium. 

What is needed is a means to close the gap between video programming 
and the information superhighway of the Internet. What is needed is a wider, 
richer experience integrating audio/visual and textual database elements into an 

15 organized unique interactive, educational, entertainment experience. Currently, 
the Internet is a repository of information on virtually any subject. However, 
what is needed is a mechanism for combining the user-friendly visual experience 
of television with the vast information resources of the Internet. 

20 SUMMARY OF THE INVENTION! 

The system of the present invention combines broadcast television 
programming and /or video programming which appears on a VHS or Beta tape, 
CD-ROM, DVD or other medium, or video programming at a video server 
(hereinafter 'Video programming") with the massive Internet, creating a new 
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and powerful educational and entertainment medium. The system allows 
consumers to receive more information in a more efficient manner than either 
television or the Internet alone. Consumers not only can see a news report on 
television, but they can also read pertinent information about the report, as well 
as explore related information about the story. The program becomes the 
introduction to a particular subject, rather than the entire subject itself. The act of 
viewing a program has now become a more engaging, enriching experience. 

The system can also create a more intimate relationship between the 
viewer and the program. The user might be solving problems or performing 
virtual experiments on the Internet site that a teacher is discussing in an 
educational television program. Similarly, the consumer might be solving 
problems that the fictional characters in a television program must solve. In both 
cases, the consumer is an active participant in the process, rather than a passive 
observer. 

Instead of an undirected and unfocused exploration of Internet sites, by 
synching specific Internet pages to the video signal, the system puts the Internet 
in context. The television program producers now can decide what additional 
information to offer their audience. This material can now be seen in the context 
of the television program. 

An additional advantage is that consumers don't have to search through 
the literally hundreds of millions of pages on the Internet to find appropriate 
material. The material has already been filtered by the program producers and 
delivered to the consumer automatically. 

Another advantage of the system is that it changes the nature of 
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advertising. Since additional information can be given to consumers 
automatically, advertising can now be more substantive, allowing customers to 
make more informed choices. Now, the act of purchasing a product seen on 
television can be streamlined - the consumer can be given the choice of buying 
5 the product instantly using the two-way capabilities of the system. 

In addition, users can take advantage of the two-way capabilities of the 
Internet to respond to polls, to send e-mail or to link to additional sites. For 
example, a viewer watching a television news program, through the system of 
the invention, can receive a stream of Web pages which provide additional, 

10 specific information relating to the news content - whether background on the 
Presidential primaries or the latest change in interest rates. 

The video programming and corresponding Internet pages can be viewed 
on personal computers equipped with a television card, but the open software- 
based approach enables anyone with a television set and JAVA enables PC to 

15 experience the system of the invention. 

By marrying the appeal of television with the two-way data transfer 
capabilities of the Internet, the system creates a powerful new medium: 
Television producers and Internet site creators can enhance their content to 
extend their brand identity and differentiate their program offerings to the 

20 millions of people who are spending more time navigating through the 

resources of the World Wide Web rather than watching television; advertisers 
can speak more directly to consumers by directly sending Web pages to the 
consumer instead of only displaying Web addresses in their commercials; and 
consumers can gain a new level of interest and interactivity over a video-based 
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medium. In addition to providing significant and immediate benefits to 
broadcasters and advertisers, the system will also present educational 
programmers with a way to more effectively use Internet resources in the 
classroom. 

Recently, several media companies have joined to create a system for 
linking the Internet and television on the personal computer, called "Intercast." 
In this system, content will be provided simultaneously with the TV video 
signal. This system, however, requires that stripped down Web pages be sent in 
the vertical blanking interval (VBI) of the video signal, using up to three scan 
lines limiting effective bandwidth to approximately 28.8 kbps. This approach, 
however, requires specialized hardware to both insert the Web pages into the VBI 
and extract these codes at each PC since it takes up to three scan lines of the VBI. 
Thus, the complexity and cost of the PC is increased. Because the Web pages are 
transmitted with the video signal, the Intercast system is not a true "two-way" 
system, but merely a one-way "piggyback" system. In addition, the Intercast is an 
analog video product, and thus, cannot handle digital video data. 

The system of the present invention, on the other hand, is a much more 
flexible, but less complex, system. The present invention supports either analog 
or digital television broadcasts without broadcasters or end-users having to alter 
their existing systems, thus enabling broadcasters to reach a wide audience within 
a short time. 

In a first embodiment, the actual Web pages are not forced into the very 
limited bandwidth of the vertical blanking interval (VBI). Instead, merely eight 
fields of line 21 of the VBI are used to deliver the relevant Internet Web page 
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addresses to the PC. These addresses are called "uniform resource locators" 
(URLs). The system then directs the particular Web browser to retrieve the 
identified Web pages from the Internet. Upon receipt of the particular Web 
page(s) / the system syncs the Web page(s) to the video signal, and at the 
5 appropriate times, presents the Web pages on one portion of the computer screen 
with the television video signal, shown in a window on another portion of the 
screen, and thus, provides the synergistic Internet and television experience. One 
of the advantages of the system of the present invention is that no specialized 
chip set need be produced and implemented into the standard PC. Thus, 

10 complexity is kept to a minimum. 

In another preferred embodiment of the present invention, the VBI is not 
used to transmit the URLs to the user. In this alternative embodiment, member 
broadcasters enter the Internet through a member account, and will be provided 
with a graphical user interface for pre-scheduling Internet addresses, or URLs, for 

15 transmission to users at particular times of day. This interface could also be used 
to transmit real time live transmissions of URLs to users at the same time as a 
broadcast. The URLs are stored in a "Link File" for later transmission over the 
Internet to the user at the broadcasters entered time, which corresponds to the 
broadcast time of an associated program. This embodiment eliminates the need 

20 to place the URLs in the VBI, and also allows the broadcaster to store more than 
one Link File for transmission to users in different time zones, for example. 
Further, more than one broadcaster could access the same master schedule if 
desired, and add or delete certain URLs to personalize the program for their local 
audiences. Also, personalization can be taken to the single user, or small group 
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of users, by having the system send a different stream of URLs to each user, 
depending on a unique user profile, for example. Thus, the personalization 
feature of the present invention allows each user to receive information 
uniquely relevant to their interests, demographics, history, etc. This embodiment 
5 makes the transmission of URLs to the user even less complex than the first 
embodiment disclosed herein. 

Thus, it is an object of the present invention to provide order and direction 
to the Internet by using television signals to place, orient and control such 
information in a meaningful context. 
10 It is an object of the present invention to create a more intimate 

relationship between the viewer and the program by enriching the learning 
experience through the provision of more in-depth information. 



DESCRIPTION OF THE DRAWINGS 

15 Figure 1 is a diagram of the system design, showing the receipt and 

decoding of video signals at the subscriber location using the method of the 
present invention. 

Figure 2 is a diagram showing an alternative system embodiment to 
achieve the integration of the Internet information with the video content by 
20 decoding the uniform resource locators at a server site and then transmitting the 
URLs to the subscriber stations via the Internet. 

Figure 3 is a flow diagram of the basic software design of the present 
invention. 

Figure 4 is a diagram showing another preferred system embodiment to 
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achieve the direct transmission of URLs over the Internet to the user at a 
broadcaster's entered time without encoding the URLs into the VBL 

PREFERRED EMBODIMENT 

The system of the present invention combines the rich visual capabilities 
of television with the vast resources of the Internet. As shown in Figure 1, a 
preferred embodiment of the invention is a computer based system for receiving 
a video program along with embedded uniform resource locators (URLs)-which 
direct the user's computer 16 to address locations, or Web sites, on the Internet 20 
to retrieve related Web pages. These Web pages correspond to the video 
presentation. The particular video programming can be delivered in analog, 
digital or digitally compressed formats (e.g., MPEG2) via any transmission means, 
including satellite, cable, wire, or television broadcast. 

The video programming is preferably created at a centralized location, i.e., 
content creation 4 as shown in Figure 1, for distribution to subscribers in their 
homes, for example. Program creation is accomplished according to any 
conventional means known in the art. After a video program is created, uniform 
resource locators are embedded, in one preferred embodiment, into the vertical 
blank interval of the video programming by the URL encoder 8, shown in Figure 
1. In this embodiment, the URLs are encoded onto eight fields of line 21 of the 
VBL Line 21 is the line associated with close captioning, among other things. 
However, the URLs could also be embedded in other fields of the VBI, in the 
horizontal portion of the video, as part of the audio channel, or in any subcarrier 
to the video. Preferably, the URLs have associated time stamps which indicate to 
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the subscriber stations when, during the video program, to display the particular 
Web pages addressed by the URLs. 

The particular information in line 21 is not part of the visual part of the 
program, and thus, is not perceptible to the human eye, thereby making it ideal to 
5 send data information to the users. While the bandwidth capacity of line 21 is 
limited, because the system of the present invention transmits only the uniform 
resource locators (URLs), and not full Web pages, there is more than enough 
capacity. Furthermore, no additional hardware is necessary at the PC 16 to 
implement the elements of the present invention. Thus, the present invention 

10 has the additional advantages of being very efficient and takes advantage of 
conventional hardware. 

Once the video program is created, it can be transmitted to user sites over 
any transmission means, including broadcast, cable, satellite, or Internet, and may 
reside on video servers. Furthermore, the video program, with embedded URLs, 

15 can be encoded on a VHS or Beta tape, DVD or other medium. 

Preferably, each receiver station comprises any Intel x86 machine 
(preferably a 486 processor, pentium processor, etc.)/ an Apple Computer, UNIX or 
any other type of standard computer workstation. The local PC 16 is preferably 
connected to either a cable and /or broadcast television connection or to a local 

20 VCR or other video source. At each subscriber site, the local personal computer 
16 preferably receives the cable transmission by cable connection on the back of 
the personal computer 16. The video/audio program can then be processed for 
display on the computer screen using any conventional PC card capable of 
displaying NTSC signals on a computer monitor, such as a WinTV card. In 
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addition to the cable connection, however, in the present invention there is also 
an Internet 20 connection created concurrently with the cable connection. 

The Internet 20 connection can be via high-speed line, RF, conventional 
modem or by way of two-way cable carrying the video programming. The local 
5 PC 16 has Internet access via any of the current ASCII software mechanisms. In a 
preferred embodiment, at each subscriber home, an associated local URL decoder 
12 receives the cable video television program, as shown in Figure 1. The local 
URL decoder 12 extracts the URLs, preferably embedded in the vertical blanking 
interval, with the use of any conventional VBI decoder device. The URL decoder 
10 12 may be either a stand-alone unit or a card which is implemented into the 
personal computer 16. 

In another preferred embodiment shown in Figure 2, the uniform resource 
locators (URLs) are encoded into the video in the same manner as described 
above. Again, the URLs are preferably encoded onto eight fields of line 21 of the 
15 VBI. However, the URL decoder 24 is located at the server site, as opposed to the 
subscriber location. When the decoder 24 receives the video program signal, it 
strips out the URL codes on line 21 of the VBI and delivers these codes 
independently to an Internet server 28. The URL code is then subsequently 
delivered over the Internet 20 to the user PC 16. Simultaneously, the video is 
20 broadcast over conventional broadcast or cable transmission means 36 to the 
user's personal computer 16. 

Another preferred embodiment of the system, shown in Figure 4, does not 
depend on, or even use, the VBI. In this preferred embodiment, the system will 
run an online service over the Internet 20. This service will be in the form of an 
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Internet Web site 62 that provides a user-interface to a database 78 and to one or 
more associated data servers 90. The service will provide member-accounts to 
TV broadcasters 66 who sign up to use the system of the invention in 
conjunction with their broadcasts. Each member broadcaster will enter the 
5 service at their computer 70 through Web browser software 74 using their 
member account by entering various identification and password information. 
Once within their account, the member will be provided with a graphical user 
interface for pre-scheduling URLs for transmission to users 118 over a direct 
Internet connection 94 at particular times of day. The same user interface, or a 

10 variation on it, can be used by broadcasters for live transmission 82 of URLs to 
users at the same time as a broadcast 86. 

For example, one example of this interface might be a scheduling calendar 
(daily, weekly, monthly, yearly) in which the broadcaster 66 may allocate time 
periods which coincide with their broadcasts 86, and during which they will send 

15 out URLs to their users to link to Web pages. For each time period (for example, 
a particular hour long period during the day) determined by the broadcaster 66 to 
be a broadcast period (a period during which they want to transmit URLs that 
correspond to a television show being broadcast from their TV broadcast facility 
110 to the external TV 114 of the user 118 at that time), the broadcaster 66 may 

20 then enter a series of URLs into an associated file ("Link File") for transmission 
over the Internet 20 at that time. This Link File might have a user interface such 
as a spreadsheet, table, or list, or it could be simply a tab-delimited or paragraph- 
delimited text-file. As an example, each of the records in the Link File consists of 
a data structure which could contain information such as: 
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(<timecode> / <URL> / <label or title>,<additional information> / <additional 
information> / ...) 

The above data structure is just one example. The records in the Link File 
preferably specify the time, Internet address (i.e. URL), label (such as an associated 
5 name), and some optional additional information, for each Web page the 
broadcaster 66 desires to launch during a show. 

When a broadcaster 66 modifies their calendar and /or the Link File 
associated with any given time period(s) in their calendar, this information is 
saved into the database 78 that is attached to the site 62. Each broadcaster 66 may 
10 maintain multiple calendars in the database 78 if they broadcast in different time 
zones, for example. 

The database 78 provides the link File records for upcoming time periods 
to a server 90, which may be one server or a distributed network of server 
programs on multiple computers across the network, to be utilized for scaling to 
15 large national or global audiences. The server 90 provides the Link File records, 
including the URLs, to the user's personal computer 16, which is connected via a 
network. Examples of possible networks include the public Internet 94, a direct 
private network, or even a wireless network. 

One feature of the above embodiment is that one or more broadcasters 66 
20 may utilize the same schedule in the database 78 for their own broadcasts 86 or 
during the same broadcast. For example, a network broadcaster may develop a 
master schedule and various affiliate broadcasters may subscribe to that schedule 
or copy it (in the database) and add or delete specific URLs in the schedule for 
their local audiences or unique programming. This scheme enables affiliates to 



WO 97/33434 



PCT/US97/03525 



14 

insert URLs for local advertisers or local subjects into a sequence of more general 
URLs provided by their network broadcaster 66. In other words, the affiliate can 
add links that ride on the network feed and then redistribute it to their local 
audiences* 

The above embodiment can also enable personalization in the form of 
unique series of URLs specific to each user's unique profile, which is directly sent 
over the Internet 20 to each user's specific client software 106. This can be 
achieved from the broadcaster 66 to each individual user 118, or to particular 
collections of users. To accomplish personalization, the service may send a 
different stream of URLs to each user's client software program 106. The stream 
of URLs sent would depend on a user profile stored in the database 78 or the 
client software program 106, a user profile which is built on demand or over time 
for each user 118 based on criteria such as the location of the user, choices the user 
makes while using a client software program 106, or choices the broadcaster 66 
makes during a broadcast 86, or automatic choices made by an algorithm (such as 
a filter) residing on the service 62. Personalization enables each user to receive 
URLs which are uniquely relevant to their interests, demographics, history, or 
behavior in the system. 

System Operation 

Once the URLs have reached the personal computer 16, system operation is 
similar for all of the embodiments diagramed in Figures 1, 2, and 4. 

In a preferred embodiment, a JAVA enabled browser 98 as well as 
specialized software 106 for performing part of the method of the present 
invention are installed on the computer 16. The JAVA enabled browser 98 
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allows the computer 16 to retrieve the Web pages 102 and is preferred software, 
since it is platform independent, and thus, enables efficient and flexible transfer 
of programs, images, etc., over the Internet 20. The specialized interface software 
106 (hereinafter, "client software")/ attached as Appendix A, acts as an interface 
5 between the video programming and the Internet functions of the present 
invention. The client software 106 retrieves URLs from the video program 
(embodiment of Figure 1) or directly from the Internet connection (embodiments 
of Figures 2 and 4), interprets these URLs and directs the JAVA enabled browser 
98 to retrieve the particular relevant Web pages 102, and synchronizes the 
10 retrieved Web pages to the video content for display on the user's computer 16, as 
shown in Figures 3 and 4 and explained in more detail below. 

In a preferred method, the URLs are encoded and embedded into the video 
signal by inserting them into the vertical blanking interval (VBI), as mentioned 
above. 

15 In another preferred embodiment, the URLs are entered by member TV 

broadcasters 66 along with specified times for transmitting the URLs to the user. 
At the appropriate times, the URLs are sent directly over the Internet to the user's 
PC 16 via the client software 106 over a direct point-to-point or multicasting 
connection. 

20 One method of the present invention has the capability to detect identical 

URLs sent directly after one another which causes the browser not to fetch URLs 
in these particular cases. As shown in Figure 3, once the URL code is received at 
the computer, the client software 106 first interprets the URL and determines in 
step 42 whether the particular URL has been received previously. If it has already 
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been received, the next received URL is interpreted for determination of prior 
receipt. If the particular URL has not been detected before, the software checks for 
misspelling in step 46 and any other errors, and if errors exist, corrects these 
particular errors. Once again, it is determined whether the URL has been 
5 previously detected. If it has, the next URL is accessed in step 38. If the URL has 
not been detected, the specific URL is added to the URL list in step 54. The specific 
URL is then sent to the Web browser, preferably a JAVA enabled browser 98. 
Upon receipt of the URL, the browser 98, in step 58, will access the Web site 
address 122 (Figure 4) indicated by the URL and retrieve the cited Web page(s) 102 

10 via the Internet. 

Viewers can view the integrated presentation in the following manner. As 
mentioned above, the video signal is processed and displayed on a video window 
on the PC screen using a WinTV card, for example. The corresponding audio is 
forwarded to the audio card and sent to the PC speakers. 

15 The actual retrieved Web pages 102, referenced by the URL, are optionally 

time stamped to be displayed on the computer screen when predetermined 
related video content is displayed in the video window, thus, enlightening and 
enhancing the video presentation by providing in-depth information related to 
the video content thereto. Another section on the screen is also preferably used 

20 to represent an operational control panel. This control panel provides a list of 
the URLs that have been broadcast and correspondingly received by the computer 
16. This control panel is updated to add a URL code each time a new URL code is 
received by the PC 16. This list gives the subscriber the flexibility to go back and 
retrieve particularly informative or interesting Web pages that have already been 
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displayed earUer in the program, or alternatively, to print them out for future 
reference. Furthermore, the list could include URLs referring to Web pages not 
displayed with the broadcast program, but that provide further information on a 
certain topic of interest to the viewer. 

The present invention can best be understood with reference to an 
example. A viewer can begin watching a musical video featuring a new band, for 
example. As the video is received by the PC 16, URLs are either being extracted 
from the vertical blanking interval or are being received directly via the Internet 
20, and are being interpreted by the client software 106. Upon direction and 
command, the JAVA enabled browser 98 retrieves particular Web pages 102 from 
Internet 20 Web sites identified in the URLs. These Web pages 102 will then be 
displayed on the video screen at particular times. Thus, for example, while the 
viewer is watching the music video, biographical information on the band can 
also be displayed adjacently to the video window. Web pages 102 could also 
include an upcoming concert schedule, or even audio clips of the band's music 
may be downloaded from the Internet 20. As another example, a user could be 
watching a program relating to financial news. While the narrator is shown 
discussing high tech stocks, Web pages corresponding to detailed financial 
performance information on high tech stocks, environment and characteristics 
can be displayed with the video on the computer screen. When the program 
narrator switches to a discussion on the weekly performance of the Dow Jones, 
Web pages presenting related financial performance information can be 
simultaneously displayed. Thus, it is evident that the present invention 
profoundly enriches the viewing and learning experience. 
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It is understood that there can exist alternative embodiments for use with 
the present invention. For example, the user can view the interactive program 
using a television set 114 or other display monitor in conjunction with the 
display screen of the personal computer 16. In this embodiment, the relevant 
5 Web pages are shown on the personal computer 16 while the video program is 
displayed on the television monitor 114. In this alternative embodiment, a cable 
set top box receives the television program from the multichannel cable. The 
personal computer 16 also receives the video program from the multi-channel 
cable and extracts the URLs, embedded in the vertical blanking interval of the 

10 video signal or directly transmitted 94 over the Internet 20. The client software 
106 extracts the URLs and retrieves the particular Web pages as described above. 
The Web pages are then synchronized with the particular video frames and 
presented to the user. It is understood that a hyperlink may exist on the Web site 
that will allow the user to automatically load the client software and call up the 

15 specific television channel referenced in the Web site. For example, someone 
browsing the Internet 20 may come upon a major television network's Web site. 
They scroll to an interesting story then click on an hyperlink to turn on the 
software which tunes the TV window to the network to enhance the information 
residing at the Web site. 

20 Furthermore, instead of receiving the video program from a transmission 

means, the video program can be addressed directly from the user site if the video 
program, with embedded URLs, is stored on a VHS, Beta, DVD or other medium. 
In this embodiment, the user PC 16 and/or television 114 are connected to a VCR, 
DVD player or other appropriate device. 
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Using the foregoing embodiments, methods and processes, the system of 
the present invention creates a synergistic experience combining the vast 
resources of the Internet with the presentation capabilities of television. 
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CLAIMS 

We claim: 

1. A system for presenting integrated television programming and 
5 corresponding related Internet information segments obtained from Web sites on 
the Internet (20), the system comprising: 

a means (16) for receiving programming, wherein the programming 
contains a video signal (36), an audio signal and one or more embedded 
uniform resource locators, wherein the embedded uniform resource 
10 locators specify one or more Internet addresses of the information 

segments which relate specifically to the content of the video and audio 
signals of the programming; 

a controller means (16), connected to the receiving means (16), 
comprising: 

15 a means (12) for decoding the uniform resource locators to 

determine the specified Internet addresses; 

a means (16), connected to the decoding means (12), for 

retrieving the one or more Internet information segments residing 

at the determined Internet addresses; and 
20 a display means (18), connected to the controller (16) and 

receiving means (16), for presenting the video and audio signals 

concurrently with the Internet information segments. 
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2. An integrated television and Internet programming reception system 
integrating relevant Internet (20) information segments obtained from Web sites 
on the Internet with television programming content, the system comprising: 

a means (16) for receiving programming, wherein the programming 
contains a video signal (36), an audio signal and one or more uniform 
resource locators, wherein the uniform resource locators are embedded in 
the vertical blanking interval of the video signal (36) and specify one or 
more Internet addresses of the information segments which relate 
specifically to the content of the video and audio signals of the 
programming; 

a means (12), connected to the receiving means (16), for extracting 
the embedded uniform resource locators from the video signal (36); 

a controller means (16), connected to the receiving means (16), 
comprising: 

a means (12) for interpreting the uniform resource locators to 
determine the specified Internet addresses; 

a means (16), connected to the decoding means (12), for 
retrieving the one or more Internet information segments residing 
at the determined Internet addresses; and 

a display means (18), connected to the controller (16) and 
receiving means (16), for presenting the video and audio signals 
concurrently with the Internet information segments. 
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3. A method for integrating television program content with relevant 
information pages from the Internet, the method comprising the steps of: 

receiving programming, the programming containing a video signal 
(36), an audio signal and one or more uniform resource locators, wherein 
5 the uniform resource locators are embedded in the vertical blanking 

interval of the video signal (36) and specify one or more Internet addresses 
of the relevant Internet information pages which relate specifically to the 
content of the video and audio signals of the programming; 

extracting the uniform resource locators from the video signal; 
10 interpreting the uniform resource locators to determine the 

specified Internet addresses; 

retrieving the one or more Internet information segments residing 
at the determined Internet addresses; and 

presenting the video and audio signals concurrently with the 
15 Internet information segments. 



4. A system for presenting integrated television programming and 
corresponding related Internet information segments obtained from Web sites 
(62) on the Internet (20), the system comprising: 
20 a first means (16, 114) for receiving programming, wherein the 

programming contains a video signal and an audio signal; 

a second means (106) for receiving one or more uniform resource 
locators, wherein the uniform resource locators specify one or more 
Internet addresses (102) of the information segments which relate 
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specifically to the content of the video and audio signals of the received 
programming; 

a controller means (16), connected to the second receiving means 
(106), comprising: 

a means (12) for decoding the uniform resource locators to 
determine the specified Internet addresses (102); 

a means (98), connected to the decoding means (12), for 
retrieving the one or more Internet information segments residing 
at the determined Internet addresses (102); and 
a display means (18, 114), connected to the controller (16) and the 
first and second receiving means (16, 106, 114), for presenting the video and 
audio signals concurrently with the Internet information segments (102). 

The system of claim 4, further comprising: 

a means (70, 74) for entering information at a member broadcaster 
Web site (62), including the uniform resource locators corresponding to a 
particular program and a time at which the particular program will be 
received by the first receiving means (16, 114); and 

a means (70) for storing the entered information. 
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6. The system of claim 5, further comprising: 

a means (74) for sending the stored uniform resource locators at the 
time at which the particular program will be received by the first receiving 
means (16, 114), directly over an Internet connection (94) to the second 
receiving means (106). 



7. A method for integrating television program content with relevant 
information pages from the Internet (20), the method comprising the steps of: 

receiving programming, the programming containing a video signal 
and an audio signal; 

receiving one or more uniform resource locators, wherein the 
uniform resource locators specify one or more Internet addresses (102) of 
the relevant Internet information pages which relate specifically to the 
content of the video and audio signals of the programming; 

interpreting the uniform resource locators to determine the 
specified Internet addresses; 

retrieving the one or more Internet information segments residing 
at the determined Internet addresses (102); and 

presenting the video and audio signals concurrently with the 
Internet information segments. 



8. 



The method of claim 7, further comprising the steps of: 

entering information at a member broadcaster Web site, including 
the uniform resource locators corresponding to a particular program and a 



WO 97/33434 



PCT/US97/D3S25 



25 

time at which the particular program will be received by a first receiving 
means (16, 114); and 

storing the entered information. 

The method of claim 8, further comprising the steps of: 

sending the stored uniform resource locators at the time at which 
the particular program will be received by the first receiving means (16, 
114), directly over an Internet connection (94) to a second receiving means 
(106). 



10. A system for presenting integrated television programming and 
corresponding related Internet information segments obtained from Web sites o 
the Internet (20), the system comprising: 

a television broadcaster data entry and broadcast means comprising: 

a means (70, 74) for accessing a service Web site (62) on the 
Internet (20), wherein a member broadcaster of television 
prograrnming accesses the service Web site (62); 

a means (70, 74) for entering information into the service 
Web site (62), wherein the entered information is comprised of 
uniform resource locators and a time at which a particular program 
will be broadcast (86) by the member broadcaster (66), wherein the 
uniform resource locators specify one or more Internet addresses 
(102) of the relevant Internet information pages which relate 
specifically to the content of the particular program being broadcast 
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by the member broadcaster (66); 

a means (70), connected to the entering means (70, 74), for 
storing the entered information; 

a first means (86,110) for sending the particular program being 
5 broadcast by the member broadcaster (66) to a user (118), wherein the 

particular program contains a video signal and an audio signal; 

a second means (74), connected to the storing means (70), for 
sending, at the time at which the particular program will be 
broadcast, the stored uniform resource locators over a direct Internet 
10 connection (94) to the user (118); 

a user terminal (16) comprising: 

a first means (16, 114) for receiving, from the first sending 
means (86, 110), the particular program, including the video and 
audio signals, being broadcast by the member broadcaster (66) to a 
15 user (118); 

a second means (106) for receiving, from the second means 
(74) for sending, the stored uniform resource locators which 
correspond to the video and audio signals received by the first 
receiving means (16, 114); 
20 a controller means (16), connected to the second receiving 

means (106), comprising: 

a means (12) for decoding the uniform resource locators 
to determine the specified Internet addresses; 

a means (98), connected to the decoding means (12), for 
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retrieving the one or more Internet information segments 
residing at the determined Internet addresses (102); and 
a display means (18, 114), connected to the controller (16) and 
the first and second receiving means (16, 106, 114), for presenting the 
video and audio signals concurrently with the Internet information 
segments. 
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